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Arthur  1)  Little  Inc 


I.  INTRODUCTION 


A.  BACKGROUND 

^The  Tri-Service  Medical  Information  Systems  (TRIM1S)  Program 
Office  (TPO)  has  installed  a  computer  system  (the  Tri-Service 
Laboratory  System  or  TRILAB)  in  three  military  hospitals: 

Naval  Regional  Medical  Center  (NRMC)  Oakland, 

California; 

lip  Dwight  D.  Eisenhower  Army  Medical  Center  (DDEAMC), 

Ft.  Gordon,  Georgia;  and 

y  Wright  Patterson  Medical  Center  and  Regional  Hospital 
(Wright  Patterson),  Dayton,  Ohio. 

The  experience  with  these  installations  is  being  evaluated  to 
provide  information  for  use  in  decision  making  about  the  future  use  of 
automation  in  clinical  laboratories  in  other  military  health  care 
facilities. 

The  "fkst  installation  was  scheduled  for  NRMC  Oakland,  which  was 
chosen  as  the  primary  evaluation  site  for  the  TRILAB  system.  The 
evaluation  plan  for  the  TRILAB  system  was  developed  by  Analytic 
Services,  Inc.  (ANSER)(^  who  also  collected  the  baseline  data  at 
Oakland  during  an  eight-week  period  (September  29,  1980-  November  29, 
1980) . 

In  addition  to  the  comprehensive  evaluation  conducted  at  NRMC 
Oakland,  "mini-evaluations"  at  the  other  two  sites  (DDEAMC  and  Wright 
Patterson)  were  subsequently  undertaken.  Baseline  data,  using 
self-administered  questionnaires,  were  collected  by  Arthur  D.  Little, 
Inc.  at  these  two  sites  in  the  fall  of  1981. 

After  review  and  evaluation  of  the  data  collected  at  NRMC 
Oakland,  it  was  decided  to  supplement  the  baseline  data  collected 
there  with  additional  data  from  DDEAMC  on  two  important  areas  of 
TRILAB  impact:  turnaround  times  for  laboratory  tests  and  volume  of 
telephone  calls  inquiring  about  test  results.  This  supplementary 
baseline  data  collection  was  carried  out  by  Arthur  D.  Little,  Inc., 
during  June  of  1982. 


/k  Arthur  D.  Little,  Inc. 


1 


Thus  four  separate  evaluation  activities  were  planned  at  the 
three  TRILAB  sites: 

•  a  full-scale  evaluation  in  the  clinical  laboratory 
NRMC  Oakland, 

•  a  focused  evaluation  (at  a  lower  level  of  effort)  to 
document  experience  at  another  site  and  to  supple¬ 
ment  quantitative  information  from  NRMC  Oakland, 

•  a  survey  of  attitudes  of  users  of  clinical  laboratory 
services  and  clinical  laboratory  personnel  at  Wright 
Patterson,  and 

•  a  survey  of  attitudes  of  users  of  clinical  laboratory 
services  and  clinical  laboratory  personnel  at  DDEAMC. 

The  system  at  Eisenhower,  the  last  of  the  three  facilities  to 
implement  TRILAB,  had  not  reached  stability  and  complete 
implementation  at  the  time  of  the  post-implementation  evaluation.  It 
was  therefore  decided  not  to  include  Eisenhower  in  the  post¬ 
implementation  evaluation,  except  for  implementation  monitoring  and 
interviews.  Based  on  the  finding  of  the  implementation  monitoring,  it 
was  anticipated  that  the  results  from  Eisenhower  would  be  consistent 
with  the  evaluation  conclusions  based  on  the  other  two  sites. 

Each  evaluation  activity  was  intended  to  be  conducted  in  two 

phases,  one  to  document  the  process  and  measure  indicators  of  service 

effectiveness  before  the  system  was  implemented  (baseline  or  X. 

Period) ,  and  another  to  assess  the  same  aspects  of  laboratory 

operations  after  the  TRILAB  system  had  been  implemented  (Y  Period). 

The  results  of  the  baseline  data  collection  were  summarized  in  the 

(2) 

report  "X  Period  Evaluation  of  the  TRILAB  System." 

This  report  presents  the  plan  for  the  Y  Period  evaluation.  The 
report  is  arranged  as  follows.  The  remainder  of  this  chapter  presents 
a  brief  description  of  the  TRILAB  system  and  an  overview  of  the  TRILAB 
objectives  and  evaluation  approach.  Chapter  II  presents  the  plan  for 
the  Y  Period  evaluation.  Appendix  A  presents  details  of  the  original 
evaluation  plan.  Appendix  B  presents  the  data  collection  forms  to  be 
used  at  NRMC  Oakland,  the  first  site  planned  for  Y  Period  data 
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collection.  These  forms  were  pretested  in  conjunction  with  the 
implementation  monitoring  visit  to  NRMC  Oakland  during  the  week  of 
August  15,  1982.  Modifications  were  made  to  the  forms  as  necessary. 

B.  DESCRIPTION  OF  TRILAB 

The  TRILAB  system  is  designed  to  support  the  following  laboratory 
activities:  patient  registration,  test  request  entry,  specimen 
accessioning  and  control,  work  document  preparation,  quality  control, 
test  result  entry,  inquiry  and  data  retrieval,  test  result  reporting, 
and  management  reporting.  The  registration  function  will  be  provided 
by  an  interface  with  the  TRI-Service  Patient  Administration  System 
(TRIPAD)  when  it  is  available. 

The  TRILAB  system  is  designed  to  have  automated,  high-volume  test 
instruments  on-line,  with  the  goal  of  significantly  reducing  clerical 
work  of  laboratory  technicians  and  transcription  errors.  The  system 
is  also  designed  to  monitor  quality  control  samples  in  order  to  check 
for  correct  calibration  of  instruments  and  proper  handling  of  the 
specimens  within  the  laboratory,  and  to  produce  interim  test  results 
reports,  daily  cumulative  reports,  and  cumulative  summary  discharge 
reports. 

In  addition,  the  system  produces  management  information,  such  as 
laboratory  workload  summary  reports,  which  should  reduce  the  effort  to 
prepare  management  and  UCA  reports  and  assist  in  the  efficient 
organization  and  administration  of  the  laboratory. 

The  TRILAB  system,  which  was  obtained  from  Centennial  Systems 
Corporation,  was  designed  as  a  freestanding  laboratory  information 
system,  that  may  also  operate  as  an  integrated  subsystem  of  a 
composite  hospital  computer  system.  The  system  can  support  terminals 
outside  the  laboratory,  such  as  in  wards,  clinics  and  satellite 
facilities  for  transmission  of  results  and  for  inquiry  as  to  test 
status. 

C.  TRILAB  SYSTEM  OBJECTIVES 

The  TRILAB  system  is  generally  intended  to  impact  effectiveness 
and  economy  of  the  clinical  laboratory.  Seventeen  specific  objectives 

for  TRILAB  were  identified  by  the  Medical  Review  Group.  These  can  be 

% 

grouped  into  four  broad  categories  of  impact: 
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1 .  Service  Performance 


•  The  availability  of  laboratory  services  should  be 
perceived  by  health  care  providers  to  increase. 

e  Health  care  providers  should  perceive  an  improvement 
in  the  legibility  of  laboratory  reports. 

•  Health  care  providers  will  perceive  that  test  order 
entry  is  being  performed  acceptably. 

•  The  time  between  the  initiation  (time  specimen  is 
supposed  to  be  collected)  of  a  laboratory  request 
and  the  receipt  of  results  by  health  care  providers 
should  decrease. 

•  The  average  number  of  return  visits  attributable  to 
lack  of  laboratory  results  should  decrease. 

•  The  number  of  STAT  laboratory  requests  that  represent 
other  than  life-threatening  requests  should  change. 

•  Health  care  providers  should  perceive  an  improvement 
in  the  availability  of  laboratory  data. 

•  Laboratory  technicians  should  perceive  an  improvement 
in  specimen  control  and  work  organization. 

•  Health  care  providers  should  perceive  an  increase  in 
usability  (convenience  and  practicability  of 
laboratory  reports) . 

2.  Service  Capability 

•  The  operational  capacity  of  the  laboratory  service 
by  time  of  day  and  day  of  week  should  increase. 

3.  Use  of  Resources 

•  The  productivity  of  laboratory  personnel  should  increase. 

•  The  number  of  man-hours  worked  by  and  associated  costs 
of  clerical  personnel  inside  the  laboratory,  normalized 
by  workload,  should  decrease. 

•  The  number  of  man-hours  worked  by  and  associated  costs 

of  professional  personnel  employed  outside  the  laboratory 
in  tasks  related  to  the  laboratory,  normalized  by  workload, 
should  decrease. 
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•  The  number  of  man-hours  worked  by  and  associated  costs 
of  technical  personnel  inside  the  laboratory,  normalized 
by  workload,  should  change. 

•  The  number  of  man-hours  worked  by  and  associated  costs  of 
clerical  personnel  outside  the  laboratory  in  tasks  related 
to  the  laboratory,  normalized  by  workload,  should  change. 

•  Non-personnel  operating  costs  of  the  laboratory,  normalized 
by  workload,  should  change. 

4.  Satisfaction/Acceptance 

•  Physicians  and  nurses  should  report  acceptance  of  the 
Tri-Service  Laboratory  System. 

D.  TRILAB  EVALUATION  PLAN 

The  evaluation  plan  for  the  TRILAB  system,  developed  by  Analytic 
Services,  Inc.  (ANSER) ^  described  36  hypotheses  regarding  the 
potential  impacts  of  TRILAB  on  the  clinical  laboratory  and  MTF.  These 
were  grouped  into  the  following  four  areas: 

•  personnel  time, 

•  satisfaction  and  perception, 

•  information  attributes,  and 

•  cost. 

The  evaluation  called  for  a  before-and-af ter  study  comparing 
manual  laboratory  operation  with  operation  of  the  laboratory  using  the 
TRILAB  computer  system.  Two  periods  of  data  collection  were  planned: 
the  X  Period  under  manual  operation  before  the  installation  of  TRILAB, 
and  the  Y  Period  when  TRILAB  is  operational. 

This  before-and-af ter  approach  was  followed  in  the  plans  for  all 
the  TRILAB  evaluations.  The  elements  to  be  measured,  the  data 
collection  techniques,  and  the  data  obtained  at  each  site,  are 
summarized  in  Table  A-l  of  Appendix  A,  which  also  contains  details  of 
the  original  evaluation  methodology. 

Four  types  of  data  were  collected  by  ANSER  during  the  baseline 
study  at  NRMC  Oakland: 
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•  time  spent  by  personnel  within  the  laboratory  in 
information  handling  activities  (using  work  sampling 
and  timed  observations) ; 

•  performance  of  services  (turnaround  time  for  test 
results  in  the  laboratory;  transcription  discrepancies; 
number  of  telephone  inquiries  about  test  results;  and 
patient  waiting  time) ; 

e  staff  perceptions  of  performance  of  services  (staff 
questionnaire  survey) ;  and 

e  staff  and  patient  satisfaction  (staff  and  patient 
questionnaire  survey) . 

At  DDEAMC,  two  types  of  quantitative  information  were  obtained  on 
performance  of  services: 

e  turnaround  time  for  laboratory  tests,  and 

•  number  of  inquiries  to  the  laboratory  about  test  results. 

As  shown  in  Table  A-l,  the  methodology  used  to  collect  data  at 
DDEAMC  involved  some  modifications  to  the  original  evaluation  plan. 
AT  NRMC  Oakland,  only  turnaround  time  within  the  laboratory 
(processing  time)  was  measured.  At  DDEAMC,  total  turnaround  time  from 
receipt  of  requisition  at  the  laboratory  reception  desk  to  receipt  of 
the  test  result  by  the  requesting  ward  or  clinic  was  measured,  in 
addition  to  laboratory  process  time.  At  DDEAMC,  the  turnaround  times 
for  four  specific  high-volume  tests  (SMAC,  glucose,  CBC  and 
urinalysis)  were  noted  separately,  from  the  overall  turnaround  time. 
The  data  on  telephone  inquiry  volume  collected  at  DDEAMC  also  differed 
from  that  collected  at  NRMC  Oakland  in  that  the  volume  of  calls 
received  during  the  evening  and  night  shifts  was  measured  in  addition 
to  the  volume  for  the  day  shift. 

The  questionnaire  surveys  carried  out  at  Eisenhower  and  Wright 
Patterson  were  similar  to  those  carried  out  at  NRMC  Oakland,  with  some 
modifications  made  to  the  survey  instruments,  e.g.,  to  reflect  the 
fact  that  Wright  Patterson  previously  had  a  laboratory  computer  system 
(AFC LAS) . 
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II.  Y  PERIOD  EVALUATION  PLAN 


A,  INTRODUCTION 

This  section  presents  the  Y  Period  evaluation  plan.  The  plan  was 
developed  with  the  following  considerations: 

1.  In  order  to  utilize  the  baseline  data  to  the  maximum 
extent,  and  to  make  the  bef ore-and-af ter  comparison 
as  consistent  and  meaningful  as  possible,  the  same 
evaluative  measures,  data  collection  methodologies, 
and  data  collection  instruments  used  in  the  X  Period 
study  were  also  used  in  the  Y  Period  study  to  the 
extent  possible.  It  was  necessary,  however,  to  modify 
the  data  collection  methodology  and  instruments  in 
several  instances,  in  view  of  the  differences  in 
procedures  in  the  laboratory  because  of  the  TRILAB 
system. 

2.  Sample  sizes  were  chosen  to  provide  as  reliable  as 

possible  data,  given  the  baseline  data  available  from 

(2  3) 

the  X  Period  evaluation.  ’ 

3.  Where  baseline  data  was  unavailable  or  was  insufficient 
for  evaluative  purposes,  we  attempted  to  collect  such 
information  via  interviews  and  review  of  any  available 
reports . 

Table  1  summarizes  the  relationship  between  the  evaluation 
elements  and  the  data  obtained  in  the  study.  A  similar  table 
summarizing  the  approach  followed  in  the  X  Period  is  presented  in 
Appendix  A  for  comparison. 

The  Y  Period  data  collection  plan  was  organized  under  the 
following  data  collection  methodologies: 

1.  Work  sampling  program  at  NRMC  Oakland,  to  collect  data 
on  distribution  of  laboratory  personnel  activities  in 
the  Y  Period  for  comparison  with  distribution  of 
activities  in  the  X  Period.  The  major  objective  was 
to  determine  whether  time  spent  in  information  handling 
activities  had  changed. 
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2.  Surveys  of  laboratory  staff,  providers,  and  patients, 
at  NRMC  Oakland  and  Wright  Patterson,  to  determine 
whether  satisfaction  with  clinical  laboratory  services 
had  changed. 

3.  Turnaround  time  study  at  NRMC  Oakland  to  determine 
whether  turnaround  process  times  for  return  of  test 
results  had  changed. 

.  Volume  of  telephone  calls  to  the  laboratory  at  NRMC 
Oakland,  to  determine  whether  changes  had  occurred 
in  volume  of  telephone  inquiries  to  the  laboratory 
as  a  result  of  the  availability  of  results  via  the 
TRILAB  system. 

5.  Interviews  and  supplementary  data  collection  at  the 
three  sites,  to  obtain  cost  data,  volume  data,  and 
other  information. 

B,  WORK  SAMPLING  OF  LABORATORY  ACTIVITIES  (NRMC  Oakland) 

In  the  X  Period  baseline  survey,  the  time  spent  by  laboratory 
personnel  in  information  handling  activities  within  the  laboratories 
was  measured  by  an  extensive  work  sampling  program  in  the  three  major 
laboratory  sections:  Hematology,  Chemistry,  and  Bacteriology. 

Fifteen  information  handling  activities  were  defined  for  work  sampling 
purposes  (these  activities  are  described  in  the  Appendix  to  the 
baseline  plan) . ^  Data  were  collected  only  during  the  daytime 
(primarily  from  0700-1600)  and  during  the  weekdays. 

In  order  to  determine  whether  the  amount  of  staff  time  devoted  to 
information  handling  activities  had  changed  as  a  result  of  TRILAB,  a 
similar  work  sampling  program  was  conducted  in  the  three  laboratory 
sections  in  the  Y  Period  study,  focusing  on  these  same  activities. 
Several  related  computer-assisted  activities  were  added  to  the  data 
collection  instrument  to  capture  the  time  spent  performing  computer 
functions  (Form  YLAB-1) .  The  data  collection  instrument  was 
sufficiently  general  that  the  same  instrument  could  be  used  in  the 
three  sections.  The  section  sampled  is  identified  on  the  form.  (The 
activities  and  definitions  are  in  Appendix  C.)^) 
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For  comparability,  work  sampling  was  conducted  during  the  day 
3hift,  Monday  through  Friday  (when  75  percent  of  the  work  is 
jerformed) .  Two  complete  weeks  of  work  sampling  were  planned  since  it 
iias  estimated  this  would  provide  sufficient  data  to  determine  whether 
significant  (25  percent)  changes  had  taken  place  in  the  amount  of  time 
ievoted  to  information  handling  activities. 

The  Y  Period  data  collection  in  the  three  laboratory  sections 
required  the  equivalent  of  one  data  collector  per  section  for  two 
*eeks,  8  hours  per  day,  5  days  per  week,  with  5-minute  sampling 
Intervals  to  obtain  the  desired  sample  size.  This  required  data 
rollectors,  at  times,  to  follow  up  to  18  laboratory  personnel.  The 
iretest  indicated  that  this  was  feasible. 

In  addition  to  work-sampling  activities,  data  collectors  recorded 
Information  on  staffing  and  volume  of  tests  by  type  of  test  as  well  as 
section,  day,  and  time  of  observation.  A  separate  staffing  and 
workload  fact  sheet  (Form  YLAB-2)  was  completed  for  each  day. 

The  previous  contractor  had  originally  planned  to  perform  work 
sampling  in  the  reception  area,  as  well  as  in  the  laboratory  sections, 
'he  method  of  observation,  however,  was  changed  to  timed  observations, 
he  timed  observations  were  ambiguous  since  it  was  not  clear  if  they 
epresent  100  percent  of  the  total  activities  that  occurred  during  a 
iven  period  of  time,  so  that  it  is  not  possible  to  determine  the 
otal  time  devoted  to  each  activity. 

Because  of  the  difficulty  in  interpreting  the  baseline  time 
jservations,  work  sampling  was  not  used  in  this  area  for  the  Y  study, 
istead,  data  was  obtained  on  staffing  changes  in  the  reception  area 
■  interviews. 

QUESTIONNAIRE  STUDY 

In  the  baseline  study  questionnaires  were  distributed  to  the 
llowing  groups  of  personnel  at  the  three  hospitals:  medical  staff 
Ds  and  dentists);  nurses,  administrative,  corpsmen  and  clerical 
iff;  laboratory  staff;  and  patients.  The  purpose  of  the 
istionnalres  was  to  determine  the  degree  of  satisfaction  of  various 
>viders,  staff  and  patients  with  regard  to  their  interaction  with 
'oratory  operations 
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In  order  to  determine  whether  the  degree  of  satisfaction  and 
perceptions  with  regard  to  laboratory  operations  changed,  a 
questionnaire  survey  was  again  undertaken  at  two  sites.  Because  many 
of  the  questions  in  the  baseline  questionnaires  at  NRMC  Oakland  did 
not  appear  to  relate  to  the  potential  impact  of  the  TRILAB  system,  the 
questionnaire  was  revised,  in  order  to  eliminate  unrelated  questions, 
and  to  include  questions  related  to  the  specific  impact  of  the  TRILAB 
system.  Where  possible,  those  questions  from  the  baseline  survey  have 
been  retained  so  that  direct  comparisons  can  be  made  in  some  areas. 

The  revised  questionnaires  are  contained  in  Appendix  B 
(Questionnaire  A;  Questionnaire  B;  and  Questionnaire  C) .  As  noted, 
they  included  questions  which  dealt  directly  with  TRILAB  objectives, 
including: 

•  perception  of  laboratory  services  availability; 

•  legibility  of  laboratory  reports; 

•  availability  of  laboratory  data; 

•  acceptance  of  TRILAB  by  physicians  and  nurses;  and 

•  satisfaction  with  laboratory  reports. 

The  distribution  of  the  Y  Period  survey  questionnaires  was 
comparable  to  that  of  the  baseline  survey.  Three  different  sets  of 
questionnaires  were  sent,  as  in  the  baseline  evaluation,  to: 

Questionnaire  A:  all  physicians,  all  nursing  staff; 

all  administrative,  clerical  and  corpsmen; 

Questionnaire  B:  all  laboratory  staff; 

Questionnaire  C:  a  sample  of  200  outpatients. 

As  was  done  in  the  baseline  survey,  the  survey  instruments  were 
sent  through  the  hospital's  internal  mail  service  to  the  hospital 
personnel,  who  were  requested  to  complete  the  forms,  seal  them  in 
pre-addressed  envelopes  and  return  them  to  a  designated  office. 

The  patient  questionnaires  were  distributed  randomly  during  the 
data  collection  period  to  patients  in  four  high-volume  clinics: 

•  Family  Practice; 

•  Internal  Medicine; 

•  OB/GYN;  and 

•  Primary  Care. 
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TURNAROUND  TIME  (NRMC  Oakland) 


An  Important  measure  of  laboratory  performance  is  the  turnaround 
time  between  collection  of  laboratory  specimens,  and  provision  of  test 
results  to  requesting  providers.  As  discussed  in  prior  reports,  the 
baseline  survey  at  NRMC  Oakland  collected  data  on  "process  time" 
within  the  laboratory;  that  is,  the  time  between  when  the  request  slip 
was  received  in  the  laboratory  and  the  time:  (a)  results  were  phoned 
to  the  requester  in  the  case  of  emergency/urgent/STAT  requests;  and 
(b)  the  time  the  completed  slip  was  placed  in  the  outbox  to  be  picked 
up  by  staff  from  wards  and  clinics,  for  routine  requests. 

At  NRMC  Oakland,  data  on  process  time  was  collected  for 
comparison  with  the  baseline  process  times.  The  following  times  were 
noted: 

•  for  STAT/urgent  requests,  the  time  between  receipt 
of  a  request  and  specimen  by  the  laboratory  and 
the  time  the  results  were  transmitted  via  terminal 
to  the  requester; 

•  for  routine  requests,  the  time  between  receipt  of 
request  and  specimen  and  availability  of  the  result 
via  terminal  inquiry; 

•  the  time  between  the  receipt  of  the  request  and 
specimen,  and  the  time  the  "daily  interim  report" 
was  available  from  the  data  processing  department, 
for  those  wards  which  receive  these  reports 
(generally  those  which  have  pre-op  patients);  and 

•  the  time  between  receipt  of  the  request  and  specimen 
by  the  laboratory,  and  the  time  the  hard-copy  results 
were  available  in  the  laboratory  for  pick  up  by  clinic 
and  ward  personnel. 

Because  of  the  major  differences  in  the  way  results  are  returned 
from  the  laboratory  to  the  clinics  and  wards  in  the  Y  Period,  the 
method  by  which  the  turnaround  process  times  were  collected  was 
different  from  that  of  the  X  Period. 
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1.  STAT  Turnaround  Time 


The  computer  system  captures  both  the  time  (date  and  time  of  day) 
"received"  (the  accession  time),  and  the  time  that  the  result  has  been 
verified  and  is  transmitted  to  the  requesting  ward  or  clinic  (a  "beep" 
is  produced  at  the  appropriate  clinic  or  ward  terminal  when  the  result 
is  available).  These  times  are  not  printed,  but  are  available  via 
terminal  inquiry. 

The  turnaround  time  was  collected  by  reviewing  an  appropriate 
sample  of  requisitions,  noting  the  time  received  in  the  laboratory  and 
the  accession  number,  and  then  obtaining  the  time  the  result  was 
available  for  the  appropriate  accession  number,  via  terminal  inquiry. 
Arrangements  were  made  to  use  a  terminal  that  was  not  in  use,  or  to  do 
the  look-up  during  off-hours. 

|  2.  Routine  Results  Turnaround  and  Time 

Similarly,  a  sample  of  routine  requisitions  was  reviewed  and  the 
time  received  in  the  laboratory  noted.  The  time  the  results  were 
available  was  determined  via  terminal  inquiry. 

3.  Interim  Report  Results  Turnaround  Time 
The  daily  interim  reports  include  the  results  and  the  date  and 

time  that  the  request  was  "received."  (Some  of  the  result  reports 
also  include  the  date  and  time  of  "collection";  time  "received"  is 
typically  about  a  half-hour  after  the  collection  time.)  The  date  and 
time  of  the  computer  print  run  is  also  noted  on  the  report.  To 
collect  the  turnaround  time  data  for  the  daily  hard-copy  interim 
reports,  the  relevant  data  from  a  sample  of  interim  reports  were 
transferred  onto  the  data  collection  form.  This  was  done  by  copying 
the  print  end  times  and  the  time  the  reports  were  picked  up  from  the 
log  kept  at  the  front  desk  of  the  data  processing  center. 

4.  Daily  Summary  Reports  Turnaround  Time 
A  similar  procedure  was  followed  to  obtain  the  print  end  and 

report  pick-up  times  for  daily  summary  reports. 

Table  2  lists  the  planned  process  time  sample  sizes  for  the  Y 
Period  data  collection.  They  were  based  on  our  analysis  of  the  X 
Period  data.  Except  for  Hematology  routine  results,  the  sample  sizes 
proposed  at  NRMC  Oakland  were  larger  than  those  collected  in  the  X 
Period.  * 
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TABLE  2 

TURNAROUND  TIME  SAMPLE  SIZE 


X  Period _  Y  Period 

Routine 


Chemistry 

51 

100 

Hematology 

250 

220 

Microbiology 

16 

35 

Chemistry 

33 

50 

Hematology 

62 

75 

The  data  collection  form  utilized  and  the  definition  of  data  elements 
are  presented  in  Appendix  B  (Form  YLAB-3). 

E.  NUMBER  OF  TELEPHONE  CALLS  TO  THE  LABORATORY  ^ 

Another  important  measure  of  laboratory  performance  is  the  volume 
of  telephone  inquiries  to  the  laboratory  for  information  about  test 
status.  Such  inquiries  not  only  take  up  time  of  both  requesters  and 
laboratory  personnel,  but  also  disrupt  work  flow  and  affect  providers' 
perceptions  of  the  quality  of  laboratory  services  and  reflect  on  the 
ability  of  the  laboratory  to  provide  results  when  required. 

In  the  X  Period  study  at  NRMC  Oakland,  the  number  of  calls 
received  by  the  laboratory  was  monitored  over  a  period  of  seven  days 
(Monday  through  Friday,  primarily  0700-1600). 

During  the  Y  Period  study  the  number  of  calls  received  was 
monitored  in  order  to  determine  the  extent  to  which  the  number  of 
calls  to  the  laboratory  changed  as  a  result  of  the  inquiry  capability 
of  the  terminals  on  wards  and  clinics.  Monitoring  of  telephone  calls 
was  carried  out  using  procedures  similar  to  those  utilized  in  the  X 
Period. 

At  NRMC  Oakland,  an  observer  was  stationed  at  the  reception  desk 
to  monitor  both  the  number  and  type  of  calls  received.  Calls  were 
categorized  as: 
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•  calls  requesting  information  from  filed  results  in 
the  reception  area; 

•  calls  requesting  information  via  terminal  look-up; 

•  calls  requesting  information  from  the  laboratory; 

•  calls  requesting  a  laboratory  chief  or  supervisor 
by  name; 

•  calls  requesting  a  laboratory  technician  by  name 
(other  than  supervisor) ;  and 

•  calls  requesting  general  information. 

In  the  baseline  study,  a  total  of  615  calls  were  monitored, 
equivalent  to  102.5  calls  per  (8-hour)  day.  This  number  of  calls  was 
determined  sufficient  to  detect  a  10  percent  change  in  calls 
requesting  information  from  the  laboratory  (for  the  day  shift,  Monday 
through  Friday).  In  the  Y  Period  study,  the  equivalent  of  two  weeks'  • 
calls  was  monitored.  The  form  utilized  to  capture  the  data  on 

telephone  calls  is  appended  (From  YLAB-4) . 

F.  PATIENT  WAITING  TIMES 

Change  in  patient  waiting  time  was  not  an  objective  of  the  TRILAB 
system  (see  Section  II-C) .  However,  in  the  baseline  study  at  NRMC 
Oakland,  data  were  collected  on  the  waiting  times  experienced  by 

patients  at  the  laboratory  reception  desk  to  have  their  blood  drawn, 
in  anticipation  that  additional  tasks  might  be  performed  at  the 

laboratory  reception  area  which  would  affect  the  patient  waiting 

times.  This  would  not  occur  until  centralized  accessioning  was 
implemented. 

The  waiting  times  experienced  by  patients  are  essentially 
determined  by  the  volume  of  patients  and  availability  of  phlebotomists 
at  any  given  time,  which  are  not  directly  affected  by  implementation 
of  the  TRILAB  system  but  rather  by  general  staffing  levels.  Therefore 
patient  waiting  times  were  not  measured  in  the  Y  Period  study. 
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A  series  of  interviews  were  conducted  at  NRMC  Oakland  and  DDEAMC 
with  key  laboratory  and  hospital  staff,  to  supplement  the  formal  data 
collection  effort.  These  interviews  were  similar  to  those  carried  out 
during  the  implementation  monitoring  visits,  and  were  designed  both  to 
obtain  a  greater  understanding  of  user  perceptions,  as  well  as  to 
obtain  supplementary  data  and  information.  The  people  interviewed  and 
the  topics  for  discussion  are  listed  below. 

Key  Laboratory  Personnel 

•  assessment  of  important  TRILAB  system  impacts; 

•  problems  encountered  and  issues  interfering  with 
benefits  realization; 

•  time  spent  on  management  reporting  and  additional 
benefits  perceived;  and 

•  changes  in  error  rates  and  duplicate  tests. 

Key  Medical/Clinical  Staff 

•  assessment  of  important  TRILAB  system 
impacts  (quantified  where  possible); 

•  problems  encountered  and  issues  interfering 
with  benefits  realization; 

•  changes  in  error  rates  and  duplicate  tests; 

•  utilization  of  flow  sheets;  and 

•  changes  in  results  filing  procedures. 

In  order  to  appropriately  compare  costs  and  benefits  associated 
with  TRILAB  at  Oakland,  it  was  necessary  to  collect  data  that  would 
allow  for  normalizing  for  system  workload  between  the  X  and  Y  time 
periods.  Thus  data  on  the  following  were  collected: 

Workload 

1.  copy  of  the  laboratory  workload  reports  by  month 
for  FY  1982; 

2.  staffing  of  the  laboratory  during  the  Y  Period; 

3.  hospital  activity:  average  census  and  average 
daily  clinic  visits. 
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•  ADP  equipment ; 

•  ADP  maintenance  and  software; 

•  ADP  personnel —  (list  of  DP  personnel  and 
determine  percent  of  time  allocatable  to 
TRILAB) ; 

•  space  and  overhead  costs;  and 
m  consumables. 

2.  One-time  Costs 

o  site  preparation; 
o  equipment ;  and 
o  software. 

H.  TRANSCRIPTION  DISCREPANCY  RATE 

As  discussed  previously  in  the  baseline  reports ^  the  X  Period 
evaluation  plan  included  determining  the  rate  of  transcription  errors 
within  the  laboratory,  by  checking  a  copy  of  the  test  result  slips 
against  the  appropriate  accession  logs,  worksheets,  the  patient's 
laboratory  data  flow  sheet  and  the  patient's  chronological  record  of 
medical  care.  It  was  planned  to  note  the  type  of  discrepancy  (e.g., 
patient  identification  data,  tests  requested,  test  results)  for  the 
cases  where  the  transcription  discrepancy  occurred. 

The  data  obtained,  however,  were  both  difficult  to  interpret  and 
the  sample  size  was  too  small  to  detect  even  large  (50  percent) 
changes  in  discrepancy  rates.  Since  there  is  no  useful  baseline  data 
on  transcription  discrepancies  at  NRMC  Oakland,  no  data  on  discrep¬ 
ancies  was  collected  in  the  Y  Period  study.  Instead,  estimates  of 
changes  in  discrepancies  were  obtained  by  interviewing  supervisory 
laboratory  personnel. 

I.  RESOURCE  REQUIREMENTS 
1 .  NRMC  Oakland 

It  was  planned  to  collect  the  required  data  at  NRMC  Oakland  in 
two  to  three  intensive  weeks  of  data  collection  during  October  1982. 
The  following  were  the  estimated  on-site  resource  requirements. 
Figure  1  presents  the  proposed  time  schedule. 
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FIGURE  I 

PROPOSED  TIME  SCHEDULE 
Y  PERIOD  DATA  COLLECTION 
NRMC  OAKLAND 
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in 


Work  Sampling 

(weeks) 

2 

Reception  Area  Telephone 

2 

Turnaround  Times 

1 

Questionnaire  Administration 

1 

Back-up 

2 

Interviews/Supervision 

2 

(Senior  Staff) 

TOTAL 

2.  Questionnaire  Administration 

Questionnaire  administration  during  the  X  Period  study  at  Wright 
Patterson  was  carried  out  by  the  staff  at  the  hospital.  Questionnaire 
administration  was  carried  out  the  same  way  for  the  Y  Period,  so  that 
no  on-site  resources  were  required. 
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APPENDIX  A 


EVALUATION  HYPOTHESES  TO  BE  TESTED 
IN  THE  TRILAB  EVALUATION  AT  NRMC  OAKLAND 
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APPENDIX  B 

Y-PERIOD  DATA  COLLECTION  FORMS 
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Performing  Test  Calculations 
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COMPARISON  OF  AVAILABLE  RESULTS 
VIA  TERMINAL  AND  HARDCOPY 


EXPLANATION  OF  FORM  YLAB-3 


Accession  Number  —  which  includes  the  lab  department,  is  the  number 
assigned  to  the  lab  request  and  specimen  as  it  appears  on  the  CRT  screen. 

REQ  LOC  —  refers  to  the  requesting  location  of  the  lab  test  as  it 
appears  on  the  CRT  screen. 

MD  Name  —  Physician  name;  needed  for  referencing  accession  numbers  when 
requesting  location  is  an  outpatient  clinic. 

Accession  Data  and  Time  —  refers  to  the  date  and  time  accessioning  takes 
place  on  the  computer  upon  receipt  of  a  request  and  specimen  by  the 
laboratory  department. 

First  Results  Available  —  is  the  date  and  time  the  first  test  results 
from  a  specimen  are  transmitted  via  terminal  (often  multiple  tests  are 
performed  on  one  specimen  and  some  results  are  available  sooner  than 
others) . 

Complete  Results  Available  —  is  the  date  and  time  all  test  results 
requested  on  a  single  specimen  are  transmitted  via  terminal. 

CRT  Process  Time  —  is  the  elapsed  time  between  receipt  of  a  request  and 
specimen  by  the  lab  department  and  the  availability  of  the  first  and 
complete  results  via  terminal  inquiry. 

Interim  Hard  Copy  Available  —  indicates  the  date  and  time  at  which  the 
"daily  interim  hard  copy  reports"  of  lab  test  results  are  available  for 
pickup  in  the  DP  department  (primarily  used  by  the  pre-op  wards). 

Interim  Hard  Copy  Process  Time  —  refers  to  the  time  between  the  receipt 
of  the  request  and  specimen  by  the  lab  department  and  the  time  the  "daily 
interim  report"  is  available  for  pickup  from  the  data  processing  department 
for  those  wards  which  receive  these  reports  (generally  those  which  have 
pre-op  patients). 

Hard  Copy  Available  —  is  the  date  and  time  the  hard  copy  lab  results  are 
available  in  the  data  processing  department  for  pick  up  by  clinic/ward 
personnel  (from  DP  operator  log). 

Process  Time  —  refers  to  the  time  between  receipt  of  the  request  and 
specimen  and  the  time  the  hard  copy  results  are  available  in  the  data 
processing  department  for  pick  up  by  clinic/ward  personnel. 
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QUESTIONNAIRE  A 


To:  USERS  OF  CLINICAL  LABORATORY  SERVICES 

Arthur  0.  Little,  Inc.,  an  independent  consulting  firm,  is  under  contract 
with  the  Department  of  Defense  to  evaluate  the  functional  performance  of  the 
TRILAB  System  at  this  medical  treatment  facility.  Results  obtained  from  this 
survey  will  be  used  in  comparison  to  those  obtained  from  a  similar  survey 
which  was  previously  administered  at  this  site. 

Your  help  with  this  evaluation  is  greatly  appreciated.  Please  return  your 
completed  questionnaire  in  the  enclosed  envelope  by  October  15,  1982. 


B-7 


V  V  t 


For  Computer  Use 


T  TT 


1.  Listed  below  are  characteristics  and  activities  associated  with  clinical  laboratory  services.  Please 
indicate  how  satisfied  you  are  with  these  attributes  as  they  exist  witn  the  TRILAB  System  by  marking 
an  "X"  in  the  column  that  best  describes  your  opinion. 


Very 

Satisfied 

Somewhat 

Satisfied 

Undecided/ 
No  Opinion 

Somewhat 

Unsatisfied 

Very 

Unsatisfied 

A.  TRILA8  SYSTEM 

Availability  of  system 

1 

2 

3 

4 

5_ 

7 

Reliability  of  system 

1 

2 

3 

4 

5_ 

a 

Accuracy  of  system 

1 

2 

3 

4 

5 

3 

3.  ASPECTS  OF  TEST  REPORT  FORM 

Clarity  of  printout 

1 

2 

3 

4 

5 

10 

Completeness  of  results  provided  by  lab  reports 

1 

2 

3 

4 

5_ 

11 

Indication  of  abnormal  values  on  lab  reports 

1 

2 

3 

4 

5_ 

12 

Conciseness  of  results  provided  by  lab  reports 

1 

2 

3 

4 

5_ 

1  3 

C.  EFFICIENCY  OF  ’‘RILA8  SYSTEM  IN  LAB 

OPERATIONS 

.e^gcn  of  time  between  ordering  STAT  inpatient 
Ijo  tests  and  obtaining  results 

1 

2 

3 

4 

5 

Lerqtn  of  time  between  ordering  routine 
inoatient  lab  tests  and  obtaining  initial 
results 

1 

2 

3 

4 

5 

15 

Length  of  time  between  ordering  STAT/ 
emergency  room  lab  tests  and  obtaining  results 

1 

2 

3 

4 

3 

is 

Length  of  time  between  ordering  routine 
outpatient  tests  and  obtaining  results 

1 

2 

3 

4 

5 

.. 

flexibility  of  lab  in  handling  special  cases 

1 

2 

3 

4 

5 

18 

Training  in  ordering  and  retrieving  laboratory 
information 

1 

2 

3 

4 

5_ 

13 

3.  RESULTS 

V-  Accuracy  of  results  with  TRILAB 

£.  INFORMATION  STORAGE  ANO  RETRIEVAL 
Access  to  laboratory  results  with  TRILA8 
V.  Access  to  paper  copy  for  STAT  results 
Retrieval  of  previous  lab  data 

■  . 

■V  Ability  to  obtain  cumulative  results  for 
individual  patients 

^  Capability  of  searching  entire  patient 
y  data  base  for  analysis  or  research 

Case  and  timeliness  of  results  of  laboratory 
tests 


1  2 

3 

4 

1  2 

3 

4 

1  2 

3 

4 

1  2 

3 

4 

1  2 

3 

4 

2 

3 

4 

5 

5 

ii 

5 

2  2 

5 

2** 

5 

25 

5 _ 

26 
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2.  Overall,  how  satisfied  ere  you  with 
the  clinical  laooratory  services 
provided  at  this  medical  center: 


Very  Sonewnat 
Satisfied  Satisfied 


Undecided/  Somewnat 
No  Opinion  .nsat-sved 

2 _ 4 _ 


/ery 

Unsatisfied 
5 _ 27 


3.  Overall ,  how  satisfied  are  you  with 
the  TRILA8  system: 


4.  Please  indicate  what  you  feel  is  an  acceptable  turnaround  time,  (from  time  of  ordering  to  receipt  of  results,, 
for  typical  lab  tests  in  days,  hours,  minutes  as  applicable: 


a)  STAT  inpatient  tests 

hours  minutes 

no 

opinion 

23-33 

31-32 

don't  know 

33 

b)  Routine  inoatient  tests 

days  nours 

minutes 

no 

opinion 

34-35 

36-37 

don't  know 

38- 

'39 

-0 

c)  STAT  emergency  room  tests 

nours  minutes 

no 

opinion 

41 

i»  3-**4 

don't  know 

a)  Routine  outpatient  tests 

days  nours 

minutes 

nc 

opinion 

4S-**7 

4d-49 

sc- 

■51 

3  2 

i.  how  often  would  you  say  the  following  occurs  witn  t 
in  the  column  that  best  describes  your  opinion. 

ne  TRILAB  system?  ’lease 

indicate  by 

narking 

and  '"< 

’* 

Often 

Occasionally 

Mo 

Opinion  Rar' 

*)  7  A 

.Not 

Dpi  icabl  e 

"ests  repeated  due  to  delay  in  filing  of 
oricinal  "-"suits 

1 

2 

3 

a 

5 

Tests  repeated  due  to  lost  results 

1 _ 

2 

3 _ 

4 

5 

Tests  repeated  due  to  results  you  consider 
inaccurate 

1 

2 

3 

4 

:'none  calls  to  lab  to  obtain  results 

1 

c 

3 

a 

5 

Unnecessary  duplication  of  report  data 

1 _ 

2 

3 _ 

4 

5 

-5  7 

5.  Old  you  work  at  this  facility  before  TRILAB  was  Installed  in  February  1982?  (check  onel 


(If  no  please  go  on  to  question  7  ) 

If  you  worked  here  oefore  TRIiAB  was  installed,  please  rate  the  relative  frequency  of  the  following  events 

with  TRILA8  compared  to  the  previous  manual  lab  operations  by  marking  with  an  "X"  in  the  column  that  best  describes 


your  opinion. 

More 

Frequently 
with  TRILAB 

Similar 
Frequency 
with  TRILAB 

Less 

No  Opinion/  Frequently 
Undecided  with  TRILAB 

Never 

with  TRILAB 

Tests  repeated  due  to  delay  in  filing  of 
original  results 

1 

2 

3 

4 

s 

59 

Tests  repeated  due  to  lost  results 

1 

2 

3 

4 

5 

Tests  repeated  due  to  results  you  consider 
inaccurate 

1 

2 

3 

4 

5 

5  1 

% 

Rhone  calls  to  lab  to  obtain  results 

1 

z 

3 

4 

5 

52 

• 

Unnecessary  duplication  of  report  data 

i 

2 

3 

4 

5 

6  3 
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7.  Please  indicate  how  frequently  you  use  the  Inquiry  capability  of  TRILAB  to  obtain  test  results  eerformeo 


witnin  eacn  of  tne  following 

time  frames: 

Often 

Occasional  1 y 

Undecided 

Rarely 

Never 

3-evious  day  1 

2 

3 

4 

5 

2-3  aays  1 

2 

3 

4 

5 

1  -  2  weess  1 

2 

3 

4 

5 

Over  2  weeks  1 

2 

3 

4 

5 

i.  (Physicians  only).  Which  of  the  following  categories  most  accurately  describes  your  use  of  the  clinical 
laboratory: 

_ Lignt  (0  to  10  cests/day) 

_ 7.  '■loaer'ate  '  to  70  tests/day? 

_ 3.  neavy  .21  or  tore  tests/Cay) 

3.  -or  oacKjrour.q  ourooses  only,  please  answer  the  following  auestions. 
al  -.rat  -3  your  orafessionai  oositior.  at  this  hospital?  {c-’ecx  one, 

_ 1.  Administrative  Officer 

_ 2.  Administrative  ioeciai ist 

_ 2.  3ta*f  Physician 

_ A.  touse  3:af"  Officer  (Intern,  Resident,  cr  -eilow) 

_ 5.  Oentist 

_ 6.  sied1cal  Student 

_ 7.  5hysician's  Assi stant/.Nurse  Pract. 

_ 3.  'lurse/LVN,  LPN 

_ 9.  Corpsman  or  "echnician 

_ p.  Registrar 

_ <.  Clerk 

_ y.  Other  (Specify _ ) 

_ Z. 

b)  In  which  department  are  you  located  (e.g.,  Cardiology,  Pediatrics,  etc.) 


;  now  long  have  you  been  working  at  this  faciiity?  (check  one) 


_ Less  than  5  months 

_ 2.  5-12  months 

_ 3.  1  to  3  years 

_ A.  3  years  or  more  (specify _ ) 

Are  you  in  tne  ,-ilitary? 

_ I .  ies 

_ 2.  No 


is  would  aopreciata  any  additional  comments  you  might  wish  to  add: 


QUESTIONNAIRE  B 


1  ini  cal  Laboratory  Personnel 

0.  Little,  Inc.,  an  independent  consulting  firm,  is  under  contract 
ie  Department  of  Defense  to  evaluate  the  functional  performance  of  the 
System  at  tnis  medical  treatment  facility.  Results  obtained  from  this 
will  be  used  in  comparison  to  those  obtained  from  a  similar  survey 
jsly  administered  at  this  site. 

alp  with  this  evaluation  is  greatly  appreciated.  Any  information 
3vide  will  be  kept  in  strict  confidence. 


For  Computer  Use 


i.  Listed  oelow  are  characteristics  and  activities  associated  with  clinical  laboratory  services.  Please 
•'naicata  now  satisfied  you  are  with  these  attributes  as  they  exist  with  one  TRILAS  System  by  marking  an 
X"  unaer  the  column  that  best  describes  your  opinion. 

Very  Somewhat  Undecided/  Somewhat  Very 
Sati sf ied  Sati sfied  No  Opinion  Unsati sf’eo  Unsatisfied 

A)  TRILAB  SYSTEM 

Availaoility  of  System  1 _  2 _  3 _  A _  5 _ 


Reliability  of  System 

1 

2 

3 

4 

5 _ 

_  ; 

-ccjracy  zf  Svs^em 

1 

2 

3 

4 

5 

* 

3)  ASPECTS  OF  TEST  ACCESSIONING 

Ease  of  test  order  entry 

1 _ 

2 

3 

4 

5 _ 

Ease  of  generation  of  specimen  labe.l 
(accuracy,  soeed) 

1 

2 

3 

4 

- 

Olaritv  of  .-.orxsneet 

1 

2 

? 

4 

5 

ASPECTS  OF  TEST  RESULTS  REPOST 

liar’  tv  of  orint-out 

1 

C 

? 

v 

4 

Entry  of  results  into  system 

1 

2 

3 

Inouiry  caoabiltiy 

1 

2 

3 

4 

5 

Availability  of  hard  cooy  results 

1 

2 

“> 

■J 

4 

5 

-  - 

Capability  of  editing  files 

1 

2 

3 

a 

5 

-  0 

01  SICICIENCY  OF  rRILAB  SYSTEM  IN  lAB  OPESAT 

Time  spent  identifying/indicating  abnormal 
/alaes 

IONS 

1 

2 

3 

4 

5 

Time  spent  on  department  log 

1 

2 

3 

4 

5 

.  5 

Medical  staff  familiarity  with  TRILAB 

1 

2 

3 

4 

5 

*  " 

Adequacy  of  your  training  with  TRILAB 

1 

2 

3 

4 

5 

E)  CRT  FUNCTIONS /TERM INAL  FUNCTIONS 

Legibility  of  CRT  Screen 

1 

2 

3 

4 

5 

2  a, 

Efficiency  of  command  functions 

1 

2 

3 

4 

5 _ 

22 

23 

Location  of  terminals 

1 

2 

3 

4 

5 

F)  RESULTS 

Quality  control  of  data 

1 

2 

3 

4 

5 

24 

Accuracy  of  results 

1 

2 

3 

4 

5 

25 

Logglng/reoorting  quality  control 
information 

1 

2 

3 

d 

_ 5 

~  Zs 

'  *• 


Very  Somewnat  undecided/  Somewnat  Very 
Satisfied  Satisfied  No  Opinion  Unsatisfied  Unsatisfied 


SI  INFORMATION  STORAGE  AND  SET^ISY^L 
Time  spent  veri-;/ing  oatient  IS  with  TRILAB 


"ests  rejiitec  due  to  lost  results 
Sud’icatitr  ■ --~r—at' :n 
"s  Strc*1®  sal  s  to  j.riti 
"•re  soent  on  nan.ua  >  ’•ecora-<eeoing 
_,re  stent  tnoning  £ r-~  -esults  to  unit 
£"ors  in  transcriotion 


ITJ 
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smmA 


■ 

■•w 

■ 

Soeed/easa  of  -esults  retrieval 

1  2 

3 

4  .  5 

Results 

1  2 

3 

4  -  .  5 

y 

V. 

Capability  of  providing  cumulative  results 
to  users 

1  2 

3 

4  5  ■  H 

W 

ii 

m 

Overall,  how  satisfied  are  you  with 

.  ,N 

one  TS1LAS  System? 

2 

3 

4  .  5 

3.  Overall,  how  satisfied  are  you  with 

clinical  laooratory  services  provided 

.*  "1 

by  tnis  medical  center? 

1  2 

3 

4  5  ,, 

m 

o.  •'’ease  indicate  now  frequently  you  feel 

the  following  occurs 

with  7RILA8  by  marx'ng  an  "X"  under  the 

%v 

«s 

to' .mn  t.nat  oes:  desc-ces  your  ooinion 

“ 

Unheeded/ 

Dfter  '..teas’ 

Ona‘1/  lo 

Opinion  -larel  V  Never 

m 


w.V 


mrn 


is 


5.  Old  you  work  in  this  laboratory  before  TRILAB  was  installed  in  February  1 982?  (.check  one) 

_ Ves 

_ No 

(If  no  ,  please  proceed  to  question  8.) 

If  you  worked^here  before  TRILAB  was  installed  please  indicate  the  relative  frequency  of  the  following 
events  since  TRILAB  installation  by  marking  an  “X"  under  the  column  that  best  describes  your  opinion. 


More 

Frequently 
with  TRILAB 

Similar 
frequency 
with  TRILAB  Never 

Less 

Frequently 
with  TRILAB 

undecided 

Telephone  calling  to  Inpatient  units/ 
outpatient  clinics 

Duplication  of  information 

1 

2 

3 

4 

5  *i 

1 

2 

3 

4 

5  *z 

Necessity  of  repeating  tests  due  to 
inaccurate  results 

1 

2 

3 

4 

5  ,  . 

Time  spent  on  manual  record  keeping 

1 

2 

3 

4 

5 

Discrepancies  in  transcription 

6.  3!ease  rank  wnat  you  feel  is  the  most 

1 

2 

3 

4 

5 

important  improvement  with 

TRILAB 

Very 

Imoortant 

Somewhat 

Imoortant 

Undecided/ 
No  Opinion 

Somewhat 

Unimportant 

Very 

JnmDortant 

-ormat  of  lab  reouest/resul ts 

1 

2 

3 

4 

5 

efficiency  of  laboratory  operations 

1 

2 

3 

4 

8  .7 

Accuracy  of  Results 

1 

2 

3 

4 

5 

Ease  of  information  storage  and  retrieval 

1 

2 

3 

4 

5  -.9 

Number  of  telephone  calls 

1 

2 

3 

4 

5  30 

finally,  for  background  purposes,  please  answer  the  following: 


a)  What  is  your  professional  specialty?  (check  one) 


1. 

Patho 1 og i st/ Phys i cl an 

2. 

Lab  Technician 

3. 

Receptionist/Clerk 

4. 

Lab  Student 

5. 

Lab  Officer 

6. 

Other  (specify) 

b)  How  long  have  you  been  working  at  this  facility?  (check  one) 


J. 

Less  than  6  months 

2. 

6-11  months 

_3. 

1  to  3  years 

_4. 

3  years  or  more  (specify _ 

) 

52 

•  c)  Are  you  in  the  military? 
.  1 .  res 


B-13 


V 


X  , 

V 


«'  3.  In  your  opinion,  are  there  any  instruments  wnich  should  be  on-line  to  the  TRIIAB  system,  but 
are  not  now?  Please  list  below. 


m 


•  9.  In  your  opinion ,  are  there  any  instruments  which  are  currently  on-line  to  TRILAB,  but  should 

not  oe?  Please  list  below. 


QUESTIONNAIRE  C 


Patients 


STUDY  OF  CLINICAL  LABORATORY  SERVICES 


Arthur  D.  Little,  Inc.,  an  independent  consulting  firm,  is  under  contract 
with  the  Department  of  Defense  to  evaluate  clinical  laboratory  services  at 
several  medical  treatment  facilities.  The  results  of  the  evaluation  will 
help  improve  the  operation  of  military  clinical  laboratories. 

You  can  help  with  this  evaluation  by  answering  the  following  questions 

about  the  current  system.  Any  information  you  provide  will  be  kept  in  strict 

confidence. 


For  Computer  Use  _ 

:  2  3 

Please  Indicate  your  answers  by  placing  an  "X"  next  to  the  response. 


Very 

Satisfied 

Somewhat 

Satisfied 

Undecided/ 
.No  Ooinion 

Somewhat 

Unsatisfied 

Very 

Unsatisfied 

Overall,  how  satisfied  are  you  with  the 
clinical  laboratory  services  at  this 

Jledical  center? 

1 

2 

3 

4 

5 

How  satisfied  are  you  with  the  amount  of 
time  you  nave  to  wait  after  you  register 
with  tne  lab  receptionist? 

1 

2 

3 

4 

5  = 

How  satisfied  are  you  with  the  amount  of 
time  you  have  to  wait  to  se  serviced  by 
a  lab  technician  (after  registration)? 

1 

2 

3 

4 

5  3 

Often 

Occasionally 

Don’t  Know 

Not  Applicable  Rarely 

Never 

How  often  has  it  been  necessary  for  you  to 
nave  i  test  repeated  due  to  lost  or  tad 

resul ts? 

1 

2 

3 

4 

5 

row  :-ten  nave  ycu  teen  delayed  at  lab 
••ecettion  area  due  to  improper  completion 
;*■  .our  test  request  *oroi? 

1 

2 

3 

4 

5 

~o r  oackgrpund  purposes  only,  please  answer 

tne  following  c 

;uestions: 

What  is  your  military  status?  (check  one) 

• 

-- 

i . 

Officer 

2. 

Enlisted 

> 

■w  • 

Dependent  of  Active  Duty 

4. 

Retl ree 

S. 

Dependent  of  Retiree 

0. 

Civi 1 ian 

7. 

Other  (Specify 

) 

I  am  currently  (check  one) 


1. 

An  inpatient 

2. 

An  outpatient 

3. 

Other  (Soecifv 

) 

We  would  appreciate  any  additional  comnents  or  suggestions  for  improvements: 


Thank  you  for  taking  the  time  to  complete  this  questionnaire. 
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APPENDIX  C 


I 

V 

y 

P 


WORK  SAMPLING  ACTIVITIES 
C-I  CHEMISTRY 
C-2  HEMATOLOGY 
C-3  BACTERIOLOGY 


to 


c-i 


Arthur  D.  Little,  Inc. 


APPENDIX  C-l 

WORK  SAMPLING  ACTIVITIES 
CHEMISTRY  SECTION 

1.  Verify/Correct  Request  Forms 

Where:  Chemistry:  Accessioning  desk  where  samples  are  received 

Who:  Staff 

When:  All  times 

What:  Includes  following  tasks: 

•  Reviewing  request  forms 

•  Making  any  changes  or  corrections  on  the  forms 

•  Preparing  additional  forms  if  necessary 

•  Telephone  physician  or  ward  for  more  information 

•  Notifying  physician  or  ward  of  changes  made 

2.  Accessioning  Specimens 

Where:  Chemistry:  Accessioning  area 

Who:  Staff 

When:  All  times 

What:  Includes  following  tasks: 

•  Stamping  numbers  onto  log  sheets,  taping  numbers 
onto  test  tubes,  writing  number  on  requisition, 
writing  patient  information  and  tests  requested 
on  log  sheet 

•  Placing  requisitions  in  appropriate  holding  boxes 

•  Typing  names  for  SMAC 

3.  Preparing  Work  Sheets 

Where:  Chemistry:  Near  accessioning  area  or  near  test 

processing  area 

Who:  Staff 

When:  Usually  done  before  test  processing  but  may  be  done 

during  or  after  test  processing 


Arthur  D.  Little,  Inc. 
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What:  Includes  the  following  tasks: 

•  Reviewing  log  sheet  or  requisitions  to  determine 
what  tests  must  be  done 

•  Selecting  appropriate  work  sheet 

•  Writing  accession  number  (and  sometimes  patient 
name)  on  worksheet 

•  Writing  control  information  and  other  information 

4.  Test  Processing 

Where:  Chemistry:  At  work  areas  where  analyses  are  performed 
Who:  Staff 

When:  All  Times 

What:  Includes  the  following  tasks: 

•  Obtaining  specimen  from  accessioning  area  and 
carrying  it  to  work  area 

•  Monitoring  instruments 

•  Putting  samples  on  instruments 

•  Working  with  sample  or  equipment 

5.  Performing  Test  Calculations 

Where:  Chemistry  Laboratory:  By  either  of  the  two  calculators 

or  hand  calculations  at  the  work 


Who:  Staff 

When:  Throughout  the  day 

What:  Includes  the  following  tasks: 

•  Using  one  of  two  calculators 

•  Performing  test  calculations  by  hand 

6.  Recording  Test  Results 

Where:  Chemistry:  All  work  areas 
Who:  Staff 

When:  After  processing  tests 

What:  Includes  following  tasks: 

•  Writing  results  from  equipment  readouts  onto 


worksheets 


•  Writing  results  of  calculations  onto  work  sheet 

•  Printing  results  by  SMAC  when  a  staff  person  is 
monitoring  the  printer 

•  Tearing  off  results  from  SMAC 
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7.  Transcribing  Test  Results 

Where:  Chemistry  work  areas  or  chemistry  accessioning  areas 

Who:  Laboratory  staff 

When:  All  times 

What:  Includes  following  tasks: 

•  Writing  results  from  worksheets  onto  test  requisitions 

•  Stapling  test  requisitions  onto  SMAC  printouts 

8.  Reporting  Test  Results 

Where:  Near  accessioning  area  of  chemistry 

Who:  Laboratory  staff 

When:  After  tests  are  completed 

What:  Includes  following  tasks: 

•  Selecting  appropriate  requisition  from  all  others 

•  Calling  the  physician  or  nursing  unit 

m  Reporting  the  test  result  on  the  telephone 
NOTE:  Reporting  the  test  results  to  walk-in  health  care  personnel 
would  be  recorded  in  Category  #11,  Responding  to  Inquiries. 

9.  Distributing  Test  Results 

Where:  Accessioning  area  in  chemistry;  also  work  area  in  front 
of  SMAC 

Who:  Laboratory  staff 

When:  After  results  are  written  onto  the  requisitions  (or  in 

the  case  of  the  SMAC  printout,  stapled  onto  the 
requisition) 

What:  Includes  following  tasks: 

•  Separating  the  requisitions  into  component  parts 

•  Sorting  the  requisitions  by  patient  area 

•  Correcting  or  completing  requisitions 

NOTE:  Alphabetizing  the  requisitions  would  be  reported  in  Category 

10.  Filing  Test  Results. 
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10.  Filing  Test  Results 

Where:  Chemistry  accessioning  area;  Chemistry  SMAC  area 
Who:  Laboratory  staff 

When:  After  results  are  written  on  requisitions 

What:  Includes  following  tasks: 

•  Alphabetizing  copies  of  requisitions  for  pathology 
file 

11.  Responding  to  Inquiries  on  Test  Status 

Where:  Accession  area  in  chemistry 
Who:  Laboratory  staff 

When:  Throughout  the  day 

What:  Includes  following  tasks: 

•  Answering  the  telephone  (in  response  to  a  page  from 
the  receptionist's  desk) 

•  Looking  up  test  results  from  the  patient's  test 
requisition  and  reporting  those  results 

•  Searching  the  section  log  sheet  to  verify  orders 
for  test  requests 

•  Reviewing  the  worksheets  to  determine  status  of  test 

•  Checking  verbally  with  staff  to  determine  status  of 
a  test 

•  Looking  up  test  results  or  test  status  for  a  walk-in 
health  care  provider 

12.  Compiling  Workload  Statistics 

Where:  Chemistry  accessioning  area 

Who:  Laboratory  staff 

When:  Usually  afternoons,  may  be  done  only  once/week 

What:  Includes  following  tasks: 

•  Retrieving  pervious  days'  accession  logs  and 
worksheets  from  files 

•  Counting  number  of  laboratory  tests  and  control 
samples  done  using  any  of  the  following: 

1)  Accession  log 

2)  Worksheets 

3)  Test  requisitions 

•  Tallying  the  counts  by  type  of  test 

•  Recording  the  totals  onto  workload  lists 
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13.  Logging,  Calculating,  and  Reporting  Quality  Control  Information 
Where:  Chemistry  work  areas 

Who:  Laboratory  staff 

When:  Daily,  sometimes  weekly 

What:  Includes  following  tasks: 

•  Reviewing  worksheets  for  quality  control  information 

•  Recording  test  results  for  controls  on  separate  list 
or  worksheet 

•  Calculating  statistics  for  quality  control  (QC) 

•  Recording  results  of  QC  analyses  on  charts  or  graphs 

14.  Administrative  Handling  of  Incoming  and  Outgoing  Test  Specimens 
Where:  Accessioning  area 

Who:  Laboratory  staff 

When:  All  times 

What:  Includes  the  following: 

•  Writing  accession  number  and  patient  information  on 
record  of  samples  being  sent  out 

•  Comparing  names  on  incoming  specimens  (from  outside 
of  hospital)  with  names  on  the  inventory  list 

15.  Other  Nonproductive  Work 
Where:  Laboratory 

Who:  Laboratory  staff 

When:  Throughout  the  day 

Where:  Includes  the  following: 

•  Socializing 

•  Non-business  use  of  telephone 

•  Other  nonproductive  time 

16.  Other  Productive  Work 
Where:  Laboratory 

Who:  Laboratory  staff 

When:  Throughout  the  day 
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What:  Includes  the  following: 

•  Business  use  of  telephone 

•  Walking  to  work  area  to  perform  work 

•  Ordering  supplies 

•  Mixing  reagents 

•  Calibrating  instruments 

•  Centrifuging  blood  specimens 

•  Discussion  (D) 

•  Helping  customer,  either  patient  or  medical  staff  (HC) 

•  Training  (T) 

•  Cleaning  laboratory  area  or  equipment  (C) 

•  Other  productive  time 

17.  Away  from  Area 

Where:  Out  of  sight  of  data  collectors 
Who:  Chemistry  staff 

When:  Throughout  the  day 

What:  Includes  those  times  that  chemistry  personnel  cannot  be 

observed  due  to  their  being  away  from  the  laboratory  and 
surrounding  area  (e.g.,  at  lunch) 

18.  Maintaining  Computer  System  and  Instrument  Interface 

Any  maintenance  or  adjustment  of  the  TRILAB  equipment, 
including  the  terminals,  printers,  and  interface  equipment  for 
on-line  instruments. 

19.  Accession 

This  activity  includes  the  following  functions,  using  any 
available  terminal: 

•  Patient  registration 

•  Request  order  entry 

•  Label  generation 


1.  Results  Entry 

Keying  in  of  results  via  terminal  for  instruments  which  are 
not  on-line  to  the  computer  system. 

2.  Results  Retrieval 

Looking  up  test  results  via  terminal  inquiry. 

3.  Results  Review 

This  includes  the  review  of  test  results,  usually  by  a 
supervisor,  for  approval  prior  to  release  to  requesters. 

4.  Edit  File 

This  includes  all  file  and  program  modifications. 

5.  Print  Reports 

This  includes  the  printing  of  reports  or  listings 
within  the  laboratory. 
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APPENDIX  C-2 

WORK  SAMPLING  ACTIVITIES 
HEMATOLOGY  SECTION 


1.  Verify/Correct  Request  Forms 

Where:  Hematology:  Accessioning  bench  where  blood  samples 

are  received 

Urinalysis:  Bench  where  urines  are  received  and 
analyzed 

Who:  Hematology  and  urinalysis  staff 

When:  All  times 

What:  Includes  following  tasks: 

•  Reviewing  request  forms 

0  Making  any  changes  or  corrections  on  the  forms 
0  Preparing  additional  forms  if  necessary 
0  Telephoning  physician  or  ward  for  more  information 
0  Notifying  physician  or  ward  of  changes  made 

2.  Accessioning  Specimens 

Where:  Hematology:  Accessioning  bench  where  blood  samples 

are  received 

Urinalysis:  Bench  where  urines  are  received  and 
analyzed 

Who:  Hematology  staff 

When:  All  times 

What:  Includes  following  tasks: 

0  Stamping  numbers  onto  log  sheets,  taping  numbers 
onto  test  tubes,  writing  number  on  requisition, 
writing  patient  information  and  tests  required 
on  log  sheet 

#  Placing  requisitions  in  appropriate  holding  boxes 

3.  Preparing  Work  Sheets 

Where:  Hematology:  At  accessioning  area; 

Two  benches  near  accession  area  where 
miscellaneous  tests  are  performed; 

Bench  near  Coulter  Counter 
Urinalysis:  In  urinalysis  work  area 

C-5 
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Who:  Hematology  staff 

When:  All  times 

What:  Includes  following  tasks: 

•  Reviewing  log  sheet  or  requisitions  to  determine 
what  tests  must  be  done 

•  Selecting  appropriate  worksheet 

•  Writing  accession  number  (and  sometimes  patient  name) 
on  worksheet 

•  Writing  control  information  and  other  information  on 
worksheet 

4.  Test  Processing 

Where:  Hematology:  Work  area 
Urinalysis  work  area 
Who:  Laboratory  staff 

When:  Throughout  day 

What:  Includes  following  tasks: 

•  Mixing  blood  samples 

•  Preparing  blood  films  (microscope  slides) 

•  Staining  blood  films 

•  Working  with  blood  sample 

0  Working  with  equipment  for  analysis.  The  Coulter  S 
prints  results  directly  onto  the  patient  requisition. 
If  a  staff  member  is  receiving  a  printout  it  should 
be  marked  under  this  category,  test  processing,  not 
under  recording. 

•  Examining  blood  under  a  microscope 

•  Working  with  urine  samples 

•  Examining  urine  specimens  under  microscope 

•  Searching  for  specimens 

5.  Performing  Test  Calculations 

Calculations  are  not  usually  performed  in  the  hematology  or 
urinalysis  laboratory.  If  an  occasional  calculation  is  made, 
record  it  in  the  "comments"  column. 
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6.  Recording  Test  Results 

Where:  Hematology  and  urinalysis  work  areas 
Who:  Laboratory  staff 

When:  After  processing  tests 

What:  Includes  the  following  tasks: 

•  Writing  results  from  equipment  readouts  onto 
worksheets 

•  Writing  results  of  microscope  examinations  of 
blood  films  onto  patient  requisitions 

•  Writing  urinalysis  test  results  onto  patient 
requisitions 

•  No  recording  of  results  should  be  noted  with  use 
of  Coulter  S 

7.  Transcribing  Test  Results 

Where:  Hematology  and  urinalysis  work  areas 

Who:  Hematology  staff 

When:  All  times 

What:  Includes  following  tasks: 

•  Writing  results  from  worksheets  onto  test 
requisitions 

8.  Reporting  Test  Results 

Where:  Hematology  and  urinalysis  work  areas 
Who:  Laboratory  staff 

When:  After  tests  are  completed 

What:  Includes  following  tasks: 

•  Calling  physician  or  nursing  unit 

0  Reporting  test  results  from  the  requisition  over 
the  telephone 

NOTE:  Reporting  test  results  to  walk-in  health  care  personnel  would 
be  recorded  in  Category  #11,  Responding  to  Inquiries. 
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9.  Distributing  Test  Results 

Where:  Hematology  and  urinalysis  work  areas  and  accession  area 
Who:  Laboratory  staff 

When:  After  results  are  written  on  requisitions 

What:  Includes  following  tasks: 

•  Separating  the  requisitions  into  component  parts 

•  Sorting  the  requisitions  by  patient  area 

•  Correcting  or  completing  requisitions 

NOTE:  Alphabetizing  the  requisitions  would  be  reported  in  Category 
10,  Filing  Test  Results. 

10.  Filing  Test  Results 

Where:  Hematology  accessioning  area 

Hematology  and  urinalysis  work  areas 
Who:  Laboratory  staff 

When:  After  results  are  written  on  requisitions 

What:  Includes  following  tasks: 

•  Alphabet uing  copies  of  requisitions  for  pathology 
file 

11.  Responding  to  Inquiries  on  Test  Status 

Where:  Hematology  accessioning  area  and  all  hematology  and 
urinalysis  work  area 
Who:  Laboratory  staff 

When:  Throughout  the  day 

What:  Includes  following  tasks: 

•  Answering  the  telephone  (in  response  to  a  page  from 
the  receptionist's  desk) 

•  Looking  up  test  results  from  the  patient's  test 
requisition  and  reporting  those  results 

0  Searching  the  section  log  sheet  to  verify  orders 
for  test  requests 

•  Reviewing  the  work  sheets  to  determine  status  of  test 

•  Checking  verbally  with  staff  to  determine  status  of 
test 

•  Looking  up  test  results  on  test  status  for  a  walk-in 
health  care  provider 
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12.  Compiling  Workload  Statistics 

Where:  Hematology  accessioning  area 

Hematology  and  urinalysis  work  areas 
Who:  Laboratory  staff 

When:  Usually  afternoons,  may  be  done  only  once/week 

What:  Includes  following  tasks: 

•  Retrieving  previous  days'  accession  logs  and  worksheet 
from  files 

•  Counting  number  of  laboratory  tests  and  control 
samples  done  using  any  of  the  following 

1)  Accession  log 

2)  Worksheets 

3)  Test  requisitions 

•  Tallying  the  counts  by  type  of  test 

•  Recording  the  total  onto  workload  lists 

13.  Logging,  Calculating,  and  Reporting  Quality  Control  Information 
Where:  Hematology  accessioning  area 

Hematology  and  urinalysis  work  areas 
Who:  Laboratory  staff 

When:  Daily,  sometimes  weekly 

What:  Includes  following  tasks: 

•  Reviewing  worksheets  for  quality  control  information 

•  Recording  test  results  for  controls  on  separate 
list  or  worksheet 

•  Calculating  statistics  for  quality  control  (QC) 

•  Recording  results  of  QC  analyses  on  charts  or  graphs 

14.  Administrative  Handling  of  Incoming  and  Outgoing  Test  Specimens 

Not  applicable. 

15.  Other  Nonproductive  Work 
Where:  Laboratory 

Who:  Laboratory  staff 

When:  Throughout  day 

What:  Includes  the  following: 

•  Socializing 

•  Non-business  use  of  telephone 

•  Other  nonproductive  time 
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16.  Other  Productive  Work 
Where:  Laboratory 

Who:  Laboratory  staff 

When:  Throughout  day 

What:  Includes  the  following: 

•  Helping  customer,  either  patient  or  medical  staff 

•  Business  use  of  telephone 

•  Walking  to  work  area  to  perform  work 

•  Ordering  supplies 

•  Mixing  reagents 

•  Calibrating  instruments 

•  Cleaning  laboratory  area  or  equipment  (C) 

•  Training  (T) 

•  Other  productive  time 

•  Blood  drawing  (BD) 

9  Central  Reception  (CR) 

17.  Away  from  Area 

Where:  Out  of  sight  of  data  collector 
Who:  Hematology  staff 

When:  Throughout  day 

What:  Includes  those  times  that  hematology  personnel  cannot 

be  observed  due  to  their  being  away  from  their  laboratory 
and  surrounding  area  (e.g.,  at  lunch). 

18.  Maintaining  Computer  System  and  Instrument  Interface 

This  activity  includes  any  maintenance  or  adjustment  of  the 
TRILAB  equipment,  including  the  terminals,  printers,  and 
interface  equipment  for  on-line  instruments. 

19.  Accession 

This  activity  includes  the  following  functions,  using  any 
available  terminal: 

•  Patient  registration 

•  Request  order  entry 

•  Label  generation 

20.  Results  Entry 

Keying  in  of  results  via  terminal  for  instruments  which  are 
not  on-line  to  the  computer  system. 

C-lU 
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22.  Results  Retrieval 


Looking  up  test  results  via  terminal  inquiry. 

23.  Results  Review 

This  includes  the  review  of  test  results,  usually  by  a 
supervisor,  for  approval  prior  to  release  to  requesters. 

24.  Edit  File 

This  includes  all  file  and  program  modifications. 

25.  Print  Reports 

This  includes  the  printing  of  reports  or  listings  within 
the  laboratory. 
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APPENDIX  C-3 
WORK  SAMPLING  ACTIVITIES 
BACTERIOLOGY  SECTION 


!.  Verify/Correct  Request  Forms 

Where:  Bacteriology:  Accessiong  desk  by  main  door 

where  bacteriology  specimens  are 
received 

Serology/Parasitology :  Small  room  across  hall  from 

bacteriology  at  the  desks  where 
specimens  and  blood  samples  are 
received 

Who:  Bacteriology  staff 

Whan:  All  times 

What:  Includes  following  tasks: 

•  Reviewing  request  forms 

•  Making  any  changes  or  corrections  on  the  forms 
a  Preparing  additional  forms  if  necessary 

a  Telephoning  physician  or  ward  for  more  information 
a  Notifying  physician  or  ward  of  changes  made 
1.  Accessioning  Specimens 

Where:  Bacteriology  Desk  by  front  door  where 

specimens  are  received 

Serology/Parasitology:  Small  room  across  hall  from 

bacteriology 

Who:  Bacteriology  staff 

When:  All  times 

What:  Includes  following  tasks: 

BACTERIOLOGY 

a  Matching  patient  requisition  to  labels  in  log  book 
(occurs  about  1500-1630) 
a  Writing  accession  number  on  label 
a  Writing  accession  number  on  requisition 
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•  Writing  patient  information  on  labels 

•  Putting  labels  into  large  notebook  (book  is  usually 
located  by  far  wall  in  main  bacteriology  room) 

•  Writing  accession  number  on  original  sample  (does  not 
include  writing  number  on  culture  media) 

•  Writing  patient  information  into  PKU  notebook 
SEROLOGY/PARASITOLOGY 

•  Writing  accession  numbers  on  log  sheet  or  in  notebook 

•  Writing  accession  number  on  request  form 

•  Writing  accession  number  on  blood  sample  or 
parasitology  specimen 

•  Writing  patient  information  on  log  sheet  or  in 
notebook 

3.  Preparing  Worksheets 

Bacteriology:  Worksheets  are  not  used 

Serology/Parasitology :  Any  work  area 
Bacteriology  staff 
All  times 

Includes  following  tasks: 

•  Reviewing  log  sheet  or  requisitions  to  determine 
what  tests  must  be  done 

•  Selecting  appropriate  worksheet 

•  Writing  accession  number  (and  sometimes  patient  name) 
on  worksheet 

•  Writing  control  information  and  other  information  on 
worksheet 

4.  Test  Processing 

Where:  Bacteriology  laboratory  main  room  and  accessioning  area 
Who:  Laboratory  staff 

When:  Throughout  day 


Where : 

Who : 
When: 
What : 
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What:  Includes  following  tasks: 

•  Innoculating  culture  media  with  specimen  in  the 
bacteriology  accessioning  area 

•  Examining  culture  media 

•  Writing  notes  and  reports  on  the  back  of  the  patient 
requisition  (writing  on  the  front  side  is  Activity  f'6) 

•  Working  with  culture  media 

•  Examining  stains  under  the  microscope 

•  Staining  slides 

•  In  the  serology /parasitology  room  any  handling  of 
specimens  except  discarding  samples  should  be 
regarded  as  test  processing 

•  Examining  specimens  under  microscope 

5.  Performing  Test  Calculations 

Calculations  are  not  usually  performed  in  the  bacteriology 
or  serology /parasitology  laboratories.  If  you  see  an  occasional 
calculation,  record  it  In  this  category. 

6.  Recording  Test  Results 

Where:  Bacteriology  and  serology/parasitology  work  areas 

Who:  Laboratory  staff 

When:  All  times 

What:  Includes  following  tasks: 

•  Writing  results  of  cultures  onto  front  of  patient 
requisition 

•  Writing  results  of  specimen  gram  stains  onto  worksheet 

•  Writing  results  of  sensitivity  tests  (usually  read 
from  large  culture  plate  with  many  small  white  discs 
on  it) 

•  Writing  results  of  serology  tests  into  notebook  or  log 
sheet 
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Transcribing  Test  Results 

Where:  Bacteriology  and  serology/parasitology  work  areas 

Who:  Laboratory  staff 

When:  All  times 

What:  Includes  following  tasks: 

•  Writing  results  from  worksheets  onto  test  requisitions 
(occurs  primarily  in  the  serology /parasitology  area) 

•  Writing  gram  stain  results  from  sheets  onto  test 
requisitions  (occurs  near  the  microscope  in  the  main 
bacteriology  laboratory) 

Reporting  Test  Results 

* 

Where:  Bacteriology  and  serology /parasitology  work  areas 

Who:  Laboratory  staff 

When:  All  times 

What:  Includes  following  tasks: 

e  Reporting  results  of  gram  smears  by  phone  to  physician 
or  nursing  unit 

•  Calling  physician  about  a  positive  blood  culture  or 
spinal  fluid  (positive  means  that  some  bacteria  is 
growing  in  the  culture) 

Distributing  Test  Results 

Where:  Bacteriology  and  serology/parasitology  work  areas 
Who:  Laboratory  staff 

When:  After  results  are  written  on  requisitions 

What:  Includes  following  tasks: 

•  Separating  the  requisitions  into  component  parts 

•  Sorting  the  requisitions  by  patient  area 


•  Correcting  or  completing  requisitions 
NOTE:  Alphabetizing  the  requisition  would  be  reported  in  Category 
#11,  Filing  Test  Results 
10.  Filing  Test  Results 

Where:  Bacteriology  and  serology/parasitology  work  areas  and 

bacteriology  accessioning  area 
Who:  Laboratory  staff 

When:  After  results  are  written  on  requisitions 
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what:  Includes  following  tasks: 

•  Alphabetizing  copies  of  requisitions  for  pathology 
file 

11.  Responding  to  Inquiries  on  Test  Status 

Where:  Bacteriology  accessioning  area  and  all  bacteriology  and 
serology/parasitology  work  areas 
Who:  Laboratory  staff 

When:  Throughout  the  day 

What:  Includes  following  tasks: 

•  Answering  the  telephone  (in  response  to  a  page  from 
the  receptionist's  desk 

•  Looking  up  test  results  from  the  patient's  test 
requisition  and  reporting  those  results 

•  Searching  the  section  log  sheet  to  verify  orders  for 
test  requests 

•  Reviewing  the  worksheets  to  determine  status  of  test 

•  Checking  verbally  with  staff  to  determine  status  of  a 
test 

9  Looking  up  test  results  or  test  status  for  a  walk-in 
health  care  provider 

12.  Compiling  Workload  Statistics 

Where:  Bacteriology  and  serology/parasitologv  work  areas 
Who:  Laboratory  staff 

When:  Usually  afternoons,  may  be  done  only  once/week 

What:  Includes  following  tasks: 

•  Retrieving  previous  days'  accession  logs  and 
worksheets  from  files 

•  Counting  number  of  laboratory  tests  and  control 
samples  done  using  any  of  the  following: 

1)  Accession  log 

2)  Worksheets 

3)  Test  requisitions 

•  Tallying  the  counts  by  type  of  test 

•  Recording  the  totals  onto  workload  lists 
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13.  Logging,  Calculating,  and  Reporting  Quality  Control  Information 

Where:  Bacteriology  and  serology/parasitology  work  areas 

Who:  Laboratory  staff 

When:  Daily,  sometimes  weekly 

What:  Includes  following  tasks: 

•  Reviewing  worksheets  for  quality  control  information 

•  Recording  test  results  for  controls  on  separate  list 
or  worksheet 

•  Calculating  statistics  for  quality  control  (QC) 

•  Recording  results  of  QC  analyses  on  charts  or  graphs 

14.  Administrative  Handling  of  Incoming  and  Outgoing  Test  Specimens 
Where:  Accessioning  area 

Who:  Laboratory  staff 

When:  All  times 

What:  Includes  the  following: 

•  Writing  accession  number  and  patient  information  on 
record  of  samples  being  sent  out 

•  Comparing  names  on  incoming  specimens  (from  outside  of 
hospital)  with  names  on  the  inventory  list 

15.  Other  Nonproductive  Work 
Where:  Laboratory 

Who:  Laboratory  staff 

When:  Throughout  day 

What:  Includes  the  following: 

•  Socializing 

•  Non-business  use  of  telephone 

•  Other  nonproductive  time 

16.  Other  Productive  Work 

NOTE:  Describe  productive  activity  in  "comments"  column 
Where:  Laboratory 
Who:  Laboratory  staff 

When:  Throughout  day 
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What:  Includes  the  following: 

•  Business  use  of  telephone 

•  Walking  to  work  area  to  perform  work 

•  Ordering  supplies 

•  Mixing  reagents 

•  Calibrating  instruments 

•  Discussion 

•  Helping  customer,  either  patient  or  medical  staff  (HC) 
9  Training 

•  Cleaning  laboratory  area  or  equipment  (C) 

•  Other  productive  time 

7.  Away  From  Area 

Where:  Out  of  sight  of  data  collector 

Who:  Bacteriology  and  serology /parasitology  staff 

When:  Throughout  the  day 

What:  Includes  those  times  that  bacteriology  and  serology/ 

parasitology  personnel  cannot  be  observed  due  to  their 
being  away  from  the  laboratory  and  surrounding  area 
(e.g. ,  at  lunch) 

8.  Maintaining  Computer  System  and  Instrument  Interface 

This  activity  includes  any  maintenance  or  adjusting  of  the 
TRILAB  equipment,  including  the  terminal,  printers,  and 
interface  equipment  for  on-line  instruments. 

9.  Accession 

This  activity  includes  the  following  functions,  using  any 
available  terminal: 

•  Patient  registration 

•  Request  order  entry 

•  Label  generation. 

0.  Worksheet  Generation 

This  activity  involves  having  the  computer  print 
"worksheets" — a  listing  of  samples  and  tests  to  be  performed 
on  a  given  laboratory  instrument. 
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21.  Results  Entry 

Keying  in  of  results  via  terminal  for  instruments  which  are 
not  on-line  to  the  computer  system. 

22.  Results  Retrieval 

•I‘-  Looking  up  test  results  via  terminal  inquiry. 

23.  Results  Review 

a 

This  includes  the  review  of  test  results,  usually  by  a 
supervisor,  for  approval  prior  to  release  to  requesters. 

24.  Edit  File 

This  includes  all  file  and  program  modifications. 

25.  Print  Reports 

■ This  includes  the  printing  of  reports  or  listings  within 

the  laboratory. 
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